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Abstract 

We survey the recent mathematical results about aging in certain simple 
disordered models. We start by the Bouchaud trap model. We then survey the 
results obtained for simple models of spin-glass dynamics, like the REM (the 
Random Energy Model, which is well approximated by the Bouchaud model 
on the complete graph), then the spherical Sherrington-Kirkpatrick model. 
We will insist on the differences in phenomenology for different types of aging 
in different time scales and different models. This talk is based on joint works 
with A.Bovier, J.Cerny, A.Dembo, V.Gayrard, A.Guionnet, as well as works 
by C.Newman, R.Fontes, M.Isopi, D. Stein. 
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1. Introduction 

Aging is an interesting long-time property of dynamics in complex disordered 
media, and in particular in certain random media. A system ages when its decor- 
relation properties are age-dependent: the older the system the longer it takes to 
forget its past. Aging has been heavily studied both experimentally, numerically 
and theoretically by physicists, in particular in the context of spin-glass dynam- 
ics, but the mathematical litterature is still rather sparse. Our interest in aging 
stemmed from the study of dynamics of mean field spin glasses models, and more 
precisely of Langevin dynamics for the Sherrington Kirkpatrick model. This re- 
mains the ultimate goal, far from being achievable. But we will survey some of the 
partial progress which has been made both in short time scales (for the spherical 
SK model, see section 4) or much longer time scales (for the REM dynamics, see 
section 3). We begin with aging the Bouchaud trap model on various graphs (see 
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section 2)even though it is not directly related to Spin Glasses, because the mech- 
anism of aging there is close to the one for the REM. This talk is based on joint 
works with A.Bovier, J.Cerny, A.Dembo, V.Gayrard, A.Guionnet, as well as works 
by C.Newman, R.Fontes, M.Isopi. 

2. Bouchaud's random trap model 

This model is simple model of a random walk trapped (or rather slowed down) 
by random wells. It is nevertheless quite rich. It has been introduced by Bouchaud 
and coworkers (see [9] for a beautiful general survey) as an ansatz to understand 
"activated" dynamics of spin glasses. 

2.1. The random energy landscape 

Consider G — (V, B) a graph where V is the set of vertices and B the set 
of bonds. We introduce a "random energy landscape" on V, a collection (E x ) xe v 
of i.i.d non-negative random variables, indexed by the vertices of the graph and 
exponentially distributed (with mean one) , i.e 

P(E X >a) = e- a . 

From these random variables, we define a random measure t on V by: 

T(x) = e? E ". 

Here (3 > is an inverse temperature parameter. We will denote by a = ^ and 
concentrate on the low temperature phase, i.e a < 1. 

The physicists would see the set of vertices V as a set of " favourable valleys" 
for the configurations of a much more complex system (for instance a spin-glass), 
— E x as the energy of the bottom of the valley x. Since these energies are usually 
the extreme values of some other random landscape (see below the discussion about 
the REM), the hypothesis that they are exponential random variables is reasonable. 
The sites x where E x is large are seen as " very favourable valleys" , or equivalently 
as very deep traps, where the system should stay for a long time, in any sensible 
definition of the dynamics. 

2.2. Bouchaud's random walk 

We consider the continuous-time Markov Chain X(t) on the set V of vertices, 
whose jump rates are given, when x and y are neighbours on the graph, by: 

W x , y = ve -m-a)E x -aE y ) 

and w x .y = if x and y are not neighbours. 

Here v > is a time-scale parameter, often set to 1, and a € [0, 1] is a symmetry 
index. 

One can also write 

w x , y = VT{x)-^T{y) a . 
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These jump rates satisfy the detailed balance equation: 

w x,yT{x) = Y Wy,xT{y). 
y£V y€V 

So that the measure r is reversible for the Markov Chain X, whatever the 
value of the parameter a. 

Notice nevertheless that the case where a = is simpler. Then the jump rate 
w x , y = depends only on the random landscape at site x. The Markov Chain X 
is simply obtained by a random time-change from the simple random walk on the 
graph. This case is always easier to handle, and will be called the Random Hopping 
Times dynamics (RHT dynamics). In this case, t(x) is simply the mean time spent 
at x. 

Remark The important feature of the random variables t(x) is the fact that they 
are heavy-tailed: 

PMx) > a) = — 

in particular their expectation is infinite, when a < 1. The whole model could in 
fact be directly defined in terms of the t(x) rather than from the energies (—E x ), 
and then one could assume that the t(x) arc i.i.d and in the domain of attraction 
of an a-stable law. 

2.3. Aging and two-point functions 

The natural question about Bouchaud's Markov Chain is to study its long-time 
behaviour, either in the "quenched" regime, i.e almost surely in the randomness 
of the energy landscape, or in the "annealed" regime, i.e after averaging in this 
randomness. One would expect a dynamical phase transition, between the high 
temperature phase where a > 1 and the low temperature phase where a < 1 . A 
general idea about the low temperature phase is that the system spends most of 
its time in very deep traps: more precisely, that by time t, the chain has explored 
a large part of the space and has found traps of depth depending on t. So that , 
at age t, with high probability the system sits waiting in a deep trap, whose depth 
is t-dependent, for a time thus depending on t, before being able to get out and 
find another deep trap. The beautiful idea put forward by the physics litterature 
is "to think in the two-times plane", i.e to consider the evolution of the system 
between two large times, generally denoted t w (like waiting time, t w is the age of 
the system) and t w + t (t is then the duration of the observation of the system) , 
and to let both t w and t tend to infinity. The next step proposed by physicists is to 
choose appropriate two-point functions, i.e functions of the evolution of the system 
in the time interval (t w , t w + t) , in order to measure how much the system forgets 
its past in this time interval. The simplest such two-point function is the quenched 
probability that the system is in the same state at times t w and t w + 1: 

R"(t w , t w + t)= P"(X(t w ) = X(t w + i)). 
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Here the probability is quenched, i.e conditioned on the random medium, and the 
superscript u> denotes this randomness of medium, i.e the i.i.d collection of energies. 
One will also consider the annealed version of this two-point function: 



where ( , ) denotes the expectation w.r.t the medium. One also considers often 
another two-point function, i.e the quenched probability that the system has not 
jumped at all in the time interval (t w , t w + t): 



Finding an "agime regime" is then proving that when t is too small as a 
function of t w (typically t = o(^) for some "aging exponent" 7), then such a two- 
point function is close to one, and when it is large enough (typically t >> t^) it is 
close to zero. Naturally it is even more desirable to find the limit of these two-point 
functions for the critical regime (typically t — Ct^). 

This program is now understood rigorously for a few important graphs, which 
we will now review. We will review the case of Z d , first for d — 1 after the work of 
Fontes-Isopi-Newman ([16],[17])and more recently Cerny (see [4], [14]), then the case 
of d = 2 (see [5]) (for d > 2 sec [14]). Then we treat the case of the complete graph 
on M points when M tends to infinity. This is in fact the original Bouchaud model, 
which was introduced as an ansatz for the dynamics of the Random Energy Model. 
We will then survey the recent results on these dynamics of the REM ([1] , [2] , [3]) 
which will be the first results really pertaining to the topic of spin glass dynamics. 

2.4. Two aging regimes for Bouchaud's model on Z 

Bouchaud's model on Z has been first studied by Fontes-Isopi-Newman, when 
a = 0, i.e for the Random Hopping Times dynamics. To understand aging in 
dimension d = 1, it is important to introduce a limiting object which will play the 
role of the random medium: 

Definition 1 The random speed measure p. 

Let (xi,Vi) be a Poisson Point Process on Rx (0,oo), with intensity measure 
av~( 1+a ^dxdv. We define a random measure p on R by 



Definition 2 The FIN (Fontes-Isopi-Newman) singular diffusion Z{s). 

Let W(t) be a standard one- dimensional Brownian Motion, and l(t,y) its local 
time at y. Define the random time-change: 



R{t w ,tw + t) — {R u {t w , t w + t)) 



n"{t w ,t w +t) = P u {X{t w ) =X(t w +s),Vs< t) 



or its annealed conterpart 



U{t w ,t w +t) = (Il"{t w ,t w +t)). 
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and its inverse 

ij} p (t) = inf{s,(j) p {s) = t). 
Then the FIN singular diffusion is Z(s) — W fip p (t)) . 

Notice that the Random speed measure and the FIN singular diffusion are 
entirely independent of the symmetry parameter a, but depend only on the tem- 
perature parameter a. 

Then the following (annealed) aging result has been proved in [16] for a = 0, 
and in [4] for general a's. 

Theorem 1 For any a < 1 and any a e [0, 1], the following limit exists 

lim R(t w ,(l + 6)t w ) = f(6). 

t w — >oo 

Moreover the function f can be computed using the singular diffusion Z : 

f{e) = {P{z{i + e) = z{\))). 

This result shows that the two-point function R exhibits an aging regime, 
t = 9t w , independently of a. To be able to feel the influence of a, one should use 
the other (annealed) two-point function Id, which exhibits another aging regime 
(see [4]). Let us introduce some notation: Denote by F the annealed distribution 
function of the important r.v p(Z(l) 

F(u) = (P(p(Z(l)<u)). 

Here the brackets denote the average w.r.t the environment i.e the randomness of 
the measure p. Let g a be the Laplace transform of the r.v r(0) a 

g a (X) = E[e-^ a ] 

and C the constant given by C = 2"- 1 [E(r(0)- 2a )] 1 - a . 

Theorem 2 For any a < 1 and any a G [0, 1], the following limit exists 

lim U(t w ,t w + 9tl) = q a (0) 

t w — >OQ 

where 7 = and this limit can be computed explicitly 

POO 

Qa(0)= / gl{C0u a - l )dF(u). 
Jo 

In particular, when a — 0, 

/>OC 

q Q {6) = / e-«dF(u). 
Jo 

These two results show that the Markov Chain essentially succeeds in leaving 
the site it has reached at age t w only after a time t of the order of t7 w , but that for 
time scales between V w and t w it will jump out of the site reached at age t w but 
will not find an other trap deep enough and so will be attracted back to the trap it 
reached at age t w . 
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2.5. Aging for Bouchaud's model on Z 2 , the RHT case 

In dimension 2, i.e on Z 2 , the only case studied is the case where a=0, the RHT 
case. An aging regime is exibited (in [5])for both quenched two-point functions 

Theorem 3 The following limits exists almost surely in the environment lo, 

lim R°{t w ,t w + 6t w ) = h{6), 

t w ^OO 

lim n»(t w ,t w + e-^-) = k(6). 

OO Intyj 

The functions h and k satisfy 

lim h(9) = lim k(9) = 1 

0^0 6^0 

and 

lim h(9) = lim k(6) = 0. 

— >oo — >oo 

In fact the functions h and k can be computed explicitly easily using arcsine laws 
for stable processes. For instance 

^ ) = sinmr f 1+e ^ _ ^ 
n Jo 

Here again there is a difference between the subaging regime ( i.e t = ^ ^ for 
n))and aging regime(i.e t = 9t w for R), but much slighter than in dimension 1. 
Indeed it is naturally much more difficult to visit a trap again after leaving it. 

There is another important difference between d=l and rf=2, noticed by [16], 
namely there is localisation in dimension 1 and not in dimension 2. More precisely, 
in <i=l 

limsupsup(P w (A:(f) = x)) > 0. 

t^oo x£Z 

And this property is wrong in dimension 2. 



2.6. Aging for Bouchaud's model on a large complete graph 

Consider now the case where G is the complete graph on M points. We will 
also study here only the case the RHT case, where a=0. We consider Bouchaud's 
Markov Chain X on G, started from the uniform measure. Then it is easy to see 
that the times of jump form a renewal process and that the two-point function 
is the solution of a renewal equation. This renewal process converges, when M 
tends to oo, to a heavy-tailed renewal process we now introduce. 

Let 

e-!aT (1+Q) dy. 

Consider n m (t w ,t w + t) the unique solution of the renewal equation 

Roo(t w ,t w +t) = 1 - Foo(t w +t) + / ~n. 00 (t w -u,t w -u + t)dF 00 {u). 

Jo 
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Theorem 4 (see [10], [3]) Almost surely in the environment, for all t w and t, 
n M {t w ,t w +t) converges to (t w ,t w +t). 

It is easy to see that the limiting two-point function IIoo (t w ,t w + t) shows 
aging. Let 

1 [°° 1 

H(0) = 

Obviously H{6) ~ 1 - when 9 tends to 0, and H{6) ~ C'J- a when 9 tends 

to oo . 



TTCosec(-) Jq (1 + x)x a dx 



Theorem 5 



So that 



lim Tl oo (t w ,t w + 0t w ) = H(6). 

t w — »oo 



lim lim U%j (t w ,t w + 9t w ) = H{6) . 

*„,— >oo M—*oo 



We will see in the next section how this simple result gives an approximation (in 
a weak sense) for the much more complex problem of aging for the RHT dynamics 
for the REM. 



3. Aging for the Random Energy Model 

We report here on the joint work with Anton Bovier and Veronique Gayrard, 
sec [1],[2], [3]. This work uses heavily the general analysis of metastability for 
disordered mean-field models in [11], [12]. Let us first, following Dcrrida, define the 
REM, often called the simplest model of a spin glass. A spin configuration a is a 
vertex of the hypercube Sn = { — 1, 1}^. As in Bouchaud model on the graph Sn 
we consider a collection of i.i.d random variables (E a ) ae s N indexed by the vertices 
of Sn. But we will here assume that the distribution of the E a 's is standard 
Gaussian. We then define the Gibbs measure ^/3,at on Sn by setting: 

M/3,iv(o-) = — 

where Z@ t N is the normalizing partition function. The statics of this model are well 
understood (see[15], and [13]). It is well known that the REM exhibits a static phase 
transition at f3 c = \J2 In 2. For j3 > f3 c the Gibbs measure gives , asymptotically when 
TV tends to oo, positive mass to the configurations a where the extreme values of 
the order statistics of the i.i.d iV(0, 1) sample (E a ) a£ s N are reached, i.e if we order 
the spin configurations according to the magnitude of their (-) energies: 

E a (l) > E a (2) > ... > E a(2 Ny 

Then for any fixed k, the mass /j,p^n(o~^ will converge to some positive random 
variable. In fact the whole collection of masses ^^^(o-^') will converge to a point 
process, called Ruelle's point process. Consider for any E, the set (which we have 
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called the top in [2] and [3] , and should really be called the bottom) of configurations 
with energies below a certain threshold un{E). 

T N {E) = {ae Sn, E a > u N (E)}. 
We will choose here the natural threshold for extreme of standard Gaussian i.i.d 



rv s, i.e 



, \ /TTTTi » E ln(N In 2) + In 4tt) 

u N (E) = V2AHn2 + i ; v ; . 

V2AHn2 2V2AHn2 



Now we define discrete-time dynamics on Sn by the transition probabilities 
Pn{<t,v) = < 



j_ e pV~ne+ ^ if cr and 77 differ by a spin-flip; 

1 _ e -PVNE+ i if(7 = 77; (3.1) 

0, otherwise. 



Notice we have here truncated the negative values of the E a 's , this truncation 
is technical and irrelevant. We could truncate much less drastically. Anyway the 
states with very negative £"s wont be seen on the time scales we are interested in. 

Then the idea defended by Bouchaud is that the motion of these REM dy- 
namics when seen only on the deepest traps T N (E) should be close to the dynamics 
of the Bouchaud model on the complete graph for large M. This is true only to 
some extent. It is true that, if one conditions on the size of the top Tn(E) to be M, 
then the sequence of visited points in Tn (E) has asymptotically, when N tends to 
00, to the standard random walk on the complete graph with M points. Neverthe- 
less Bouchaud's picture would be completely correct if the process observed on the 
top would really be Markovian, which is not the case, due to a lack of time scales 
separation between the top and its complement. Nevertheless it is remarkable that 
in a weak asymptotic form Bouchaud's prediction about aging is correct. Let us 
consider the following natural two-point function: 

U N (n,m) = 1 J2 u An,m) 

1 N[ n aeT N (E) 

where H a (n,m) is the quenched probability that the process starting at time in 
state a does not jump during the time interval (n, n + m) from one state in the top 
Tn(E) to another such state. 

Theorem 6 Let (3 > (3 C Then there is a sequence cn.e ~ e f3 ^ UN ^ E \ such that for 
any e > 



I ^-N{CN,Etw,CN,E{tw + *)) 



lim Jim Jim P(\ " N ^,^wv,^ Z <-„ ) _ X | > e) = . 



Remark 1 The rescaling of the time by the factor cn.e shows that Bouchaud's 
trap model is a good approximation of the REM dynamics for the very large time 
asymptotics, on the last time scale before equilibrium is reached. This is to be 
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contrasted with the other model of glassy dynamics for spin glasses, as advocated 
by Parisi, Mezard or Cugliandolo-Kurchan where the infinite volume limit is taken 
before the large time limit. We will see in the next section an example of such a 
very different aging phenomenon in a much shorter time-scale. 

Remark 2 The REM is the first model on which this study of aging on very long 
times scales (activated dynamics)has been rigorously achieved. This phenomenon 
should be present in many more models, like the Generalized Random Energy 
Model, which is the next achievable goal, or even in much harder problems like 
the p-spin models for large enough p's. The tools developped in [11] [12] should be 
of prime relevance. 



4. Aging for the spherical Sherrington-Kirkpatrick 



Studying spin glass dynamics for the Sherrington Kirkpatrick model might 
seem premature, since statics are notoriously far from fully understood, as opposed 
to the REM. Nevertheless, following Sompolinski and Zippclius, a mathematical 
study of the Langevin dynamics has been undertaken in the recent years jointly with 
A.Guionnet (see [7], [8], [19]). The output of this line of research has been to prove 
convergence and large deviation results for the empirical measure on path space as 
well as averaged and quenched propagation of chaos. The same problem has been 
solved by M. Grunwald for discrete spins and Glauber dynamics, see [18]. The law 
of the limiting dynamics (the self consistent single spin dynamics) is characterized 
in various equivalent ways, from a variational problem to a non-Markovian implicit 
stochastic differential equation, none of which being yet amenable, for the moment, 
to a serious understanding. 

The Sherrington-Kirkpatrick Hamiltonian is given by 



with a N x N random matrix J = (Jij)i<ij<N of centered i.i.d standard Gaussian 
random variables. The Langevin dynamics for this model are described by the 
stochastic differential system : 



where B is a A^-dimensional Brownian motion, and U a smooth potential growing 
fast enough to infinity. It was proved in [8], [19] that, for any time T > 0, the 
empirical measure on path space 



model 





(4.2) 
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converges almost surely towards a non Markovian limit law Q^ , when the initial 
condition is a "deep quench", i.e when x = {x 3 ,l < j < N} are i.i.d. Q^ o is 
called the self consistent single spin dynamics in the physics litterature. It is the 
law of a self-consistent non Markovian process, which is very hard to study. One 
expects that the long time behaviour of this process shows an interesting dynamical 
phase transition, and in particular exhibits aging. A consequence of the convergence 
stated above is that the limit of the empirical covariance exists, and is simply the 
autocovariance of the law Q^ o : 

1 N f 

C(t w ,t w +t) := Km —^2x^x1^= / x tw x tw+ tdQl {x). 

Unfortunately it is not possible to find a simple, autonomous equation satisfied 
by C, or even by C and the so-called response function R. This is a very hard open 
problem. But in the physics litterature (mainly in the work of Cugliandolo and 
Kurchan) one find that the same program is tractable and gives a very rich picture 
of aging for a large class of models, i.e the spherical p-spin models. 

We report here on the joint work with A.Dcmbo and A.Guionnet [6], on the 
simplest of such models, i.e the Spherical SK, or spherical p-spin model with p=2. 
The general case of p > 2 is harder and will be our next step in the near future. In 
this work, we study the Langevin dynamics for a spherical version of the Sherrington 
Kirkpatrick (SSK) spin glass model. 

More precisely, we shall consider the following stochastic differential system 

N 1 JV 

du\ =pJ2 J a u i dt - f'ijj + dWt (4.3) 

where /' is a uniformly Lipschitz, bounded below function on R + such that f(x)/x — ► 
oo as x — > oo and (W)i<i<N is an A^-dimensional Brownian motion, independent 
of { Jij} and of the initial data {uq}. 

The term containing / is a Lagrange multiplier used to implement a "soft" 
spherical constraint. 

Here again the empirical covariance admits a limit 

1 N 

C(t w ,t w +t) := lim — VV t w x l t +t . 

i=l 

But now, as opposed to the true SK model, this limiting two point function is 
easily computable from an autonomous renewal equation. Indeed the induced ro- 
tational symmetry of the spherical model reduces the dynamics in question to an 
A^-dimensional coupled system of Ornstein-Uhlenbeck processes whose random drift 
parameters are the eigenvalues of a GOE random matrices. 

Theorem 7 There exists a critical j3 c such that: When starting from i.i.d initial 
conditions: If (3 < (3 C , then 



C(t w ,t w +t)< C exp(-5 \t - s\) 
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for some Sp > 0, Cp < oo and all (t w ,t). 

If [3 — [3 C , then C(t w ,t w +t) — > as t — > oo. Ift w /t is bounded, then the decay 

is polynomial t^ 1 ^ 2 , and otherwise it behaves like \™ +t ■ 
If (3 > (i c then the following limit exists 

lim C(t w ,t w +9t w ) = f{6). 

Moreover if t 3> t w 3> 1, then C(t w ,t w + t)-^- 3 ^ 4 is bounded away from zero 
and infinity. In particular, the convergence of C (t w ,t w + t) to zero occurs if and 
only if j > oo . 

In these much shorter time scales than for the former sections, the aging phe- 
nomenon we exhibit here is quite different than the one shown in the REM. Here the 
system has no time to cross any barrier, or to explore and find deep wells, it simply 
goes down one well, in very high dimension. In some of these very many directions 
(corresponding to the top eigenvectors of the random matrix J), the curvature of 
the well is so weak that the corresponding coordinates of the system are not tightly 
bound and are very slow to equilibrate. These very slow components are responsible 
for the aging phenomenon here. 
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